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SYSTEM AND METHOD FOR CONNECTING GEOGRAPHICALLY 
DISTRIBUTED VIRTUAL LOCAL AREA NETWORKS 

Related Application 

[0001] This application claims priority under 35 U.S.C. § 119(e) to U.S. 
Provisional Patent Application No. 60/227,862, filed August 24, 2000. 

Background of the Invention 

[0002] The present invention relates to Virtual Local Area Networks (VLANs). 
VLANs allow multiple community groups to coexist within one bridge. A bridging 
community is identified by its VLAN ID. As described in IEEE 802. lq standard, 
if a system that supports VLANs receives a frame from the LAN, the frame will 
only be admitted to a LAN which belongs to the same community. A disadvantage 
of the VLAN standard 802. lq is that it does not support interactions over Wide 
Area Networks (WANs). It is desired to have a VLAN supported over a wide area 
network because it would allow the logical grouping of resources between a 
customer premise equipment (CPE) location and a point of presence (POP) 
location. 

[0003] For this reason, it is desired to have systems and apparatus that support 
VLANs over wide area networks. 

Summary of the Invention 

[0004] The present invention comprises a unit that allows VLANs to extend over 
wide area networks. In one embodiment, the VLAN frames are bridged and sent 
to another VLAN segment across the WAN. This bridging embodiment has a 
number of disadvantages. First, the bridging adds to the overhead of the data 
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transfer over the WAN. Additionally, the use of bridging reduces the flexibility of 
the transmissions over the WAN. 

[0005] In a preferred embodiment, a unit provides VLAN ID tagging based on a 
logical interface at the unit. The logical interface can be a physical interface, such 
as a Tl or Ethernet port, multi-link combination of physical connections, such as 
multi-linked Tls, or virtual connections, such as a virtual circuit, or an aggregated 
virtual circuit. Other possible logical interfaces include DS3, CT3, and EL 
VLAN tables stored in the unit associate VLAN IDs with logical interfaces of the 
unit. In one embodiment, when data is received at a logical interface and the 
VLAN tagging is enabled, the data is tagged with the VLAN ID to send to a 
VLAN on the other side of the LAN interface. Thus, the VLAN ID need not be 
sent over the WAN, reducing the WAN data transfer overhead. 
[0006] Another embodiment of the present invention comprises a VLAN tagging 
unit having multiple logic interfaces. Different logical interfaces on the VLAN 
tagging unit are associated with different customer networks. The customer 
networks transmits data to the VLAN tagging unit across a WAN. The VLAN 
tagging unit produces a VLAN ID for data associated with a customer network. 
The production depends at least partially on the logical interface of the VLAN 
tagging unit on which the data is received. The VLAN tagging unit uses the 
VLAN ID to produce VLAN frames to send to additional networks elements. Data 
is explicitly combined with the VLAN ID only after the VLAN tagging unit tags 
the data with the VLAN ID. 

[0007] In another embodiment, the customer networks do include a VLAN ID 
such that data is sent in VLAN frames, including the VLAN ID. In one 
embodiment, another VLAN tagging unit strips the VLAN information from the 
data before sending it to the first VLAN tagging unit across a WAN. 
[0008] In another embodiment of the present invention the production of the 
VLAN ID further depends upon other information such that multiple VLAN IDs 
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can be used for data received at the same logical interface. This allows the unit to 
associate flows coming to the unit with different VLAN IDs, such that the element 
in the network associate with the unit can handle the flows differently, 
[0009] Another embodiment of the present invention comprises a system 
including a customer network using a first VLAN ID. A first VLAN tagging unit 
is adapted to convert VLAN frames into data in a format without a VLAN ID. The 
data in the format without the VLAN ID is sent across the WAN to a second 
VLAN tagging unit. The second VLAN tagging unit converts the data in the 
format without a VLAN ID into VLAN frames with a second VLAN ID. The first 
and second VLAN IDs need not be the same. One way to implement such a 
system is to use Internet Protocol (IP) multiplexing such that networks elements on 
the LANs associated with the first and second tagging units are given a spoofed 
medium access (MAC) addresses, the spoofed MAC addresses corresponding to a 
WAN interface connection for the units. Network elements in the local area 
networks address the units with the spoofed address, the units using the spoofed 
address to determine what WAN interface to send the data in the format without the 
VLAN ID. The second VLAN tagging unit receives the data without the VLAN 
ID and adds a VLAN ID to form VLAN frames according to the VLAN table in 
the second VLAN tagging unit. 

[0010] Another embodiment of the present invention concerns a unit associated 
with customer networks and at least one WAN. The customer networks are 
associated with different logical interfaces on the unit. The customer networks 
need not be directly connected to those interfaces. The unit allows the transfer of 
data associated with a VLAN across the WAN. The unit maintains a table of 
VLAN IDs, and associated logical interfaces, such that when data associated with 
the VLAN is received, it can be forwarded to each of the associated logical 
interfaces other than the logical interface on which the data is received. This 
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allows the unit to transmit the VLAN frames onto the multiple interfaces when the 
VLAN ID is associated with multiple interfaces. 

[0011] Another embodiment of the present invention concerns a unit associated 
with customer networks and at least one WAN. Different logical interfaces on the 
unit being associated with different customer networks. The unit allowing transfer 
of data associated with VLAN across the WAN. The unit maintaining a VLAN 
table of VLAN IDs, logical interfaces associated with each VLAN ID, and at least 
one service parameter. Based on the VLAN ID, the unit is adapted to use a surface 
parameter to affect data transferred from the unit. The service parameter can be a 
quality of service (QOS) indication, a translation indication, a compression 
indication, an encapsulation indication, an encryption indication or another 
processing indication. 

[0012] Still yet another embodiment of the present invention concerns a unit 
associated with at least one WAN. Different logical interfaces on the unit being 
associated with different customer networks. The unit allowing transfer of data 
associated with the VLAN across the WAN. The unit maintaining a table of 
VLAN IDs, and at least one associated quality of service indication. Data from the 
multiple VLANs having different VLAN IDS are sent across the same WAN 
connection. The quality of service indication determines how bandwidth is divided 
between the VLANs. In one embodiment, the quality of service indication includes 
a committed information rate (CIR) indication, an indication of the e burst rate, and 
policing policy indication. The quality of service indications can also be a 
prioritization indication that allows the prioritization of data being sent across the 
WAN. 

[0013] Still yet another embodiment of the present invention concerns a unit 
associated with a customer network and at least one WAN. Different logical 
interfaces on the unit being associated with different customer networks. The unit 
maintains a table of VLAN IDs and associated logical interfaces. The VLAN table 
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also contains Internet Protocol (IP) addresses associated with the different logical 
interfaces such that a network address translation of IP addresses is done at least in 
part due to the logical interface from which the data is received. In one 
embodiment, this translation comprises network address translation (NAT). In one 
embodiment, this translation is an IP version 4 to IP version 6 addresses 
translation. 

[0014] Still yet another of the present invention concerns a system in which at 
least one VLAN ID is a management ID that allows the management of network 
elements, such that elements associated with other VLAN IDs cannot access the 
management functions. In one embodiment, connectivity is checked using the 
management VLAN ID, In another embodiment, the unit converts non-VLAN ID- 
based management instructions to VLAN ID-based management instructions. 
[0015] Still yet another embodiment of the present invention comprises a system 
in which a VLAN ID table in the unit is updated dynamically during the operation 
of the unit. In one embodiment, this dynamic updating is done by examining the 
VLAN IDs of data being transferred through the unit along with the logical 
interfaces of the incoming data. In one embodiment, the test messages are 
broadcast across the logical interfaces in order to get responses for this dynamic 
update. In another embodiment, the VLAN ID table is dynamically updated by 
obtaining VLAN ID table information from other units in a management function. 

Brief Description of the Drawing Figures 

[0016] Fig. 1A is a diagram that illustrates the transfer of bridged 802. lq VLAN 
frames over WAN links. 

[0017] Fig. IB is a diagram that illustrates the operation of a unit of the present 
invention in converting the bridged 802. lq frames into regular 802. lq frames for 
the system of Fig. 1A. 
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[0018] Fig. 2 A is a diagram that illustrates a VLAN tagging unit which converts 
bridged Ethernet frames into 802. lq VLAN frames. 

[0019] Fig. 2B is a diagram that illustrates the operation of the tagging unit of 
Fig. 2 A in converting bridged 802.3 frames into 802. lq frames. 
[0020] Fig. 3A is a diagram that illustrates the transmission of forwarded IP 
frames across WAN links being sent to a VLAN tagging unit which converts it to 
802. lq VLAN frames. 

[0021] Fig. 3B is a diagram that illustrates the conversion of unbridged stripped 
frames into 802. lq frames for the system of Fig. 3 A. 

[0022] Fig. 4 is a diagram that illustrates one embodiment of how stripped non- 
bridging frames are transferred over a wide area network using IP multiplexing and 
VLAN ID tagging. 

[0023] Fig. 5 is a diagram that illustrates one embodiment of the system of the 
present invention. 

[0024] Fig. 6 is a diagram that illustrates a VLAN table for the embodiment of 
Fig. 5. 

[0025] Fig. 7 is a VLAN table of one embodiment of the present invention. 
[0026] Fig. 8 is a diagram that illustrates a VLAN table of another embodiment 
of the present invention. 

[0027] Fig. 9 is a diagram that illustrates a VLAN tagging unit of one 
embodiment of the present invention. 

[0028] Fig. 10 is a block diagram that illustrates the VLAN tagging units of one 
embodiment of the present invention able to implement the VLAN tagging. 
[0029] Fig. 11 is a diagram illustrating the output of a VLAN forwarding table 
content request and a VLAN forwarding statistics sample output for one 
embodiment of the present invention. 

[0030] Fig. 12 is a diagram that illustrates one embodiment of a system of the 
present invention. 
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[0031] Fig. 13 is a diagram that illustrates another embodiment of the system of 
the present invention. 

[0032] Fig. 14 is a diagram that implements still another embodiment of the 
system of the present invention. 

[0033] Figs. 15 and 16 are diagrams that illustrate the flow-based VLAN tagging 
of one embodiment of one system of the present invention. 
[0034] Fig. 17 is a diagram that illustrates a system using the units of one 
embodiment of the present invention. 

[0035] Fig. 18 is a diagram that illustrates a flow control for one embodiment for 
the system of the present invention. 

Detailed Description of the Preferred Embodiment 

[0036] Fig. 1A is a diagram that illustrates one embodiment of the system of the 
present invention. The system 20 includes a number of customer networks 22, 24 
and 26. In this embodiment, the customer networks are associated with the VLAN 
switches 28, 30 and 32. The VLAN switching changes the normal Ethernet frames 
into 802. lq VLAN frames. These 802. lq VLAN frames are sent to the units 34, 
36 and 38. These units append the Point to Point Protocol (PPP) header, or other 
protocol header, and bridge the 802. lq frames to the unit 40. The unit 40 strips 
the PPP header, or other protocol header and other overhead from the frames and 
sends the stripped 802. lq VLAN frames off to other elements, such as the VLAN 
switch 42. 

[0037] Fig. IB illustrates the stripping operation of the unit 40 shown in Fig. 1. 
As shown in Fig. IB, the unit 50 receives a bridge frame, containing within it an 
802. lq Ethernet frame. The unit 50 strips the 802. lq frame and transmits it to 
additional network elements. Such a bridging operation is like the operation 
described in the request for comments, RFC 2878, of the network working group 
for PPP bridging control protocol (BCP) of July 2000. Bridging, as shown in Figs. 
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1A and IB, has a number of disadvantages. First, bridging adds overhead, in this 
case the PPP header, and a cyclical redundancy check (CRC) field. An additional 
disadvantage is that bridging does not have flexibility in controlling the VLAN ID. 
Furthermore, as described below, flow-based VLAN ID tagging cannot be done 
with bridging. 

[0038] Fig. 2 A illustrates another of the system of the present invention. In this 
embodiment, customer networks 52, 54 and 56 connect to bridges 58, 60 and 62. 
The bridges 58, 60 and 62 transmit bridged Ethernet frames across WAN links to 
the VLAN tagging unit 64. The VLAN tagging unit tags the data with the VLAN 
ID. The tagged data is sent in 802. lq VLAN frames to a VLAN switch 66, which 
then can send the data to the backbone router 68. Note that as shown in Fig. 2 A, 
data from the customer networks 52, 54 and 56 are sent to different logical 
interfaces at the VLAN tagging unit 64. By examining the logical interfaces of the 
incoming data, an associated VLAN ID can be inserted in the 802. lq VLAN 
frame. This is shown in Fig. 2B. 

[0039] In Fig. 2B, a bridged 802.3 frame contains a 802.3 frame between the 
PPP header and a CRC. The tagging unit 70 examines the logical interface from 
which the incoming data is received (in this case, logical interface B). The VLAN 
table is checked, and in this case the logical interface B is associated with the 
VLAN ID equal to 20. The output 802. lq frame includes additional data as is 
shown by the VLAN table, which includes the VLAN ID = 20. According to the 
802. lq specification, the 802. lq frame header is implemented by including an E- 
Type field 72a and a VLAN ID field 72b. The E-Type field is set to 0x8100, 
which indicates VLAN frames. The E-Type for the payload is shifted down into 
field 72c. Note that the E-Type field 72c matches the E-Type field of the bridged 
802.3 frame. 

[0040] Fig. 3 A illustrates customer networks 74, 76 and 78. They are connected 
to routers 80, 82 and 84. The router sends IP frames according to the Point to 
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Point Protocol to the unit 86. The WAN links to the unit 86 are such that the 
networks 74, 76 and 78 are associated with different input WAN logical interfaces 
for the unit 86. Using the input WAN logical interface, the VLAN tagging unit 86 
is adapted to produce 802. lq VLAN frames which can be sent to other network 
elements, such as the VLAN switch 88 and the backbone router 90. Fig. 3B 
illustrates the operation of VLAN tagging for the unit 86 shown in Fig. 3 A. In this 
embodiment, the tagging unit 92 receives an unbridged stripped frame on logical 
interface B. The 802. lq frame is constructed and sent to the other units. The 
802. lq frame header includes an E-Type field 94c indicating that the type is a 
VLAN type, and a field 94d indicating that the VLAN ID is 20. The VLAN ID is 
associated with the logical interface B. The destination medium access control 
MAC address field 94a is a preferred embodiment calculated using the destination 
IP address in the payload 94f. A table within the tagging unit 94 is used to 
determine the destination medium access control address that is associated with the 
destination IP address of the IP packet in the payload. The source MAC address, 
in the field 94b, is preferably constructed using spoofed source MAC address as 
described in the IP multiplexing method described below. 

[0041] IP multiplexing is a method for the transparent forwarding of IP packets 
between a LAN and a WAN interface. LAN to LAN forwarding is accomplished 
through a proxy Address Request Protocol (ARP) process. A unit maps a unique 
spoofed MAC address to each WAN link and then responds with this spoofed 
MAC address when a device on the LAN broadcasts an ARP request for a remote 
device. These MAC addresses serves as tags for forwarding packets received on 
the LAN. IP multiplexing differs from bridging and switching in that it does not 
flood traffic and does not perform address learning. IP multiplexing devices differ 
from routers in that they do not appear as a router hop and they cannot be specified 
as a default router or gateway on a LAN. IP multiplexing is layer 2/layer 3 fast 
forwarding technique that forwards IP packets to Ethernet LANS and WAN 
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connections to multiple subscribers without using routing. IP multiplexing 
aggregates Internet protocol traffic based on IP addresses. 

[0042] Fig. 4 illustrates the operation of IP multiplexing in one embodiment of 
the present invention. The router 100 broadcasts an ARP request for router 104. 
The unit 102 recognizes that the router B is reachable across the WAN interface IB 
based upon a configured IP route. The unit 102 responds with the spoofed MAC 
address which is mapped to interface IB of unit 102. In this case, the spoofed 
MAC address is MAC X. The router 100 then unicasts a ping echo request to 
MAC address MAC X. The unit 102 interprets this request to send a PPP frame 
to unit 103. Unit 103 checks the IP pay load and transfers the ping request to the 
router 104. The echo reply from router 104 to router 100 is handled in the same 
manner. 

[0043] As shown in Fig. 4, in one embodiment, a 802. lq frame can be sent to 
the unit 102. The 802. lq frame includes a VLAN ID field 106d, which is set to 
10. The destination MAC address in field 106a is set to MAC X. The unit 102 
strips the 802. lq header and sends it over the interface IB corresponding to the 
spoofed MAC address, MAC X. The unit 102 transfers a PPP frame, including 
the PPP header 108a, and IP payload 108b, to the unit 103. The unit 103 
constructs an 802. lq frame. The destination MAC address, 110a, is determined by 
examining the IP payload and checking the correspondence for the IP address of 
the router 104 with its MAC address. The source MAC address in field 1 10b is 
spoofed to MAC Y, corresponding to interface 2A, connected to the WAN bundle 
105. Note that the VLAN ID in field 1 lOd is set to 20 by the VLAN table in the 
unit 20. In effect, the same VLAN has different VLAN IDs in the network 
segment on the left of unit 102 and the network segment on the right of unit 103. 
[0044] Looking at Fig. 3 A, the different WAN interfaces are associated with 
different spoofed MAC addresses, as well as different VLAN IDs. Incoming data 
to the unit 86 has the spoofed source MAC field 94b corresponding to the LAN 
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logical interface on which the data is received. The unit 86 converts the spoofed 
destination MAC into the correct LAN interface to transmit the data to router 80, 
82 or 84. 

[0045] Fig. 5 illustrates one embodiment of the present invention. In this 
embodiment, the customer premise equipment (CPE), includes customer networks 
112, 114 and 116, Customer networks 112, 114 and 116 are connected to VLAN 
switches 118, 120 and 122. These VLAN switches 118,120 and 122 are connected 
to the units 124, 126 and 127. The WAN connections are sent to the unit 130. 
The unit includes a logical interface A, logical interface B and logical interface C, 
which correspond to WAN connections. The unit 130 also includes the logical 
interface D, which is a LAN network connection, such as an Ethernet connection to 
the VLAN switch 132. The VLAN switch 132 can send data to the correct 
customer networks 134 or 136, depending upon the VLAN ID. 
[0046] Fig. 6 illustrates an example of a VLAN table for the VLAN tagging unit 
130 of Fig. 5. The VLAN table VLAN IDs as well as the associated logical 
interfaces for the VLAN IDs. In this embodiment, the logical interfaces include 
WAN interfaces and LAN interfaces. 

[0047] Looking again at Fig. 5, in one embodiment, unit 130 dynamically 
constructs the VLAN table. One method of doing this is by snooping on 
transmitted packets having a VLAN ID field. Thus as packets are received at a 
logical interface of the unit 130, the VLAN ID of the input data is associated with 
the input logical interface. This method can be implemented by using a test 
broadcast from the VLAN 130 to determine which units are connected to the 
different logical interfaces and what the associated VLAN IDs are. A number of 
different algorithms are available to prevent such broadcasts from flooding the 
system. 

[0048] In an alternate embodiment, information from the VLAN tables of other 
units, such as units 124, 126 or 127, is transferred to the unit 130 to expand the 
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VLAN table in the VLAN 130. Thus, in this embodiment, the unit 124 transmits 
that it is associated with the VLAN ID = 10. Unit 127 transmits that it is 
associated with the VLAN ID = 10, and unit 126 transmits that it is associated 
with the VLAN ID = 20. The unit 130 sends to each of the units 124, 126 and 
127 an indication that it is associated with VLAN IDs 10 and 20. In one 
embodiment, the VLAN units 124, 126, 127 and 130 use the logical interface over 
which the response is received to associate with the VLAN IDs indicated by the 
response. Note that such a dynamic transfer of information from VLAN tables 
between units requires VLAN ID assignment consistency for each portion of a 
VLAN (both on the right of unit 130 and to the left of units 124, 126 and 127). In 
another embodiment, the units 124, 126, 126 and 130 have their VLAN tables 
statically set. 

[0049] Fig. 7 illustrates a VLAN table in which multiple VLAN IDs are 
associated with the same logical interfaces. In this case, flow indications such as 
an IP subnet, TCP port, UDP port, destination IP address, source IP address or the 
like is used to differentiate between the multiple VLAN IDs. This VLAN table can 
be used for implementing flow control as described with respect to Figs. 15 and 
16. 

[0050] Fig. 8 is a diagram that illustrates a VLAN table in one embodiment. In 
this embodiment, the VLAN table includes the VLAN IDs, associated logical 
interfaces, flow indications that help distinguish VLAN IDs based on flows, and 
service indications, such as the quality of service translation, encryption, 
compression, encapsulation and the like. Different service indications affect how 
the data is modified. In one embodiment, the units transmit encrypted data across 
the WAN as indicated by an encryption indication. 

[0051] The VLAN table can also include a networked address translation (NAT) 
indication. Looking again at Fig. 4, network address translation in the units 102 
and 103 can spoof IP addresses between the two different sides of the VLAN. 
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Thus, for example, the router 104 could have its IP address translated into another 
range for transmissions to the router 100. In one embodiment, a unit 102 or 
103 converts from a first IP address range to a second IP address range. Network 
address translation can also be done to convert between the IP version 4 address 
scheme and the IP version 6 address scheme. 

[0052] Fig. 9 illustrates a VLAN tagging unit 140. The VLAN tagging unit 140 
implements the VLAN tagging as described above. The VLAN tagging unit 140 
also preferably implements multi-link functions. Thus, multiple WAN 
connections, such as multiple Tls, can be combined together into one logical 
interface. Customers can obtain a larger bandwidth than that provided by a Tl 
alone. The Tl links are aggregated by the VLAN tagging unit 140. The VLAN 
tagging unit 140 also preferably implements IP multiplexing such that the WAN 
interconnections, such as the Tl or aggregated Tls in a multi-link are associated 
with a spoofed MAC address. Additionally, In one embodiment, the WAN tagging 
unit 140 does additional functions associated with service parameters. These 
functions can include, as described above, encryption, compression, translation or 
the like. Additionally, in one embodiment, the VLAN tagging unit 140 implements 
quality of service and network address translation as described above. 
[0053] Logical interfaces 142 of the VLAN tagging unit include, but are not 
limited to, Tls, multi-link aggregated Tls, fractional Tl units, Ethernet LAN 
connections, virtual circuits and aggregated virtual circuits. In a preferred 
embodiment, the multi-link functions of the VLAN tagging unit 140 link together 
multiple Tls into logical WAN bundles, which are used in the VLAN tagging 
functions. 

[0054] Fig. 10 is a block diagram of one example of a VLAN tagging unit 150 
used to implement tagging in one embodiment of the present invention. This block 
diagram shows the unit connected to eight Tl lines, sending data to the octal Tl 
line interface 152, octal Tl frame 154, multi-channel High Level Data Link 
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Control (HDLC) controller 156 and eventually to PCI bus 158. Other connections 
to the unit 150 include two 10/100 Base-T Ethernet connections 160 and 162 which 
connect to the Ethernet physical layer units 164 and 166 as well as the Ethernet 
MAC layer units 168 and 170 and eventually to the Peripheral Component 
Interconnect (PCI) bus 156. PCI system controller 172 is associated with a CPU 
174 and a CPU bus 176. The CPU bus 176 is also connected to memory including 
SDRAM 178 and flash memory 180. The VLAN tagging operations are typically 
done by the CPU 174 running software stored in memory. Other architectures for 
the VLAN tagging unit can be used. The VLAN tagging units of the present 
invention are not limited to the architecture of Fig. 10. 

[0055] In one embodiment, the VLAN tables are statically updated. The user 
can configure the VLAN forwarding table based on VLAN ID tags in the range 
1 - 4095. The VLAN table consists of an association between a VLAN tag ID and 
all the outbound logical interfaces that the frame should be forwarded on. In one 
embodiment, when a VLAN frame is received by the interface software, it 
preferably looks up the VLAN ID in the VLAN table, and forwards the frame to 
all specified outbound interfaces. In the preferred embodiment, if the VLAN 
frame is received on an interface that is not configured for VLAN forwarding, and 
that particular VLAN ID is not associated with an outbound interface, the VLAN 
frame is dropped. VLAN frame is not transmitted on the interfaces that it is 
received on. Preferably the VLAN tagging units support normal IP traffic along 
with the VLAN frames. 

[0056] In a preferred embodiment, the units are configured and managed using 
control instructions. In one embodiment, these instructions include a VLAN 
forwarding feature enable, VLAN forwarding feature disable (which preferably 
clears the forwarding configuration table), temporary VLAN forwarding feature 
disable (which disables VLAN forwarding but retains the forwarding configuration 
table), and VLAN forwarding enable feature (which re-enables the VLAN 
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forwarding feature disabled in the temporary disabling step). Other commands are 
preferably used to allow a VLAN forwarding on a specific interface for specified 
VLAN ID or range of VLAN IDs. An additional command is used to remove the 
VLAN forwarding on a specified interface for a specific VLAN ID or range of 
VLAN IDs. One command changes the default 802.1 q Ethernet type from the 
default 0x8100. A reset default command is also available in a preferred 
embodiment. 

[0057] In one embodiment, some commands monitor the VLAN forwarding. 
One command displays the forwarding table for each VLAN ID. Another 
command displays the forwarding table for a specific VLAN ID or a range of 
VLAN IDs. Another command displays all VLAN forwarding statistics, and 
another displays the VLAN statistics for a VLAN ID or range of VLAN IDs. Fig. 
1 1 illustrates the output of one example of the output associated with the display of 
the forwarding table and the forwarding statistics. 

[0058] In one embodiment, some commands clear the VLAN statistics or clear a 
specific range in the VLAN statistics. Additional commands are used to clear the 
VLAN forwarding table or clear a VLAN IDs or a range of VLAN IDs from the 
forwarding table. 

[0059] A number of commands deal with remote system management through 
VLAN tag packets. With this option enabled, units can be managed inbound 
through VLAN tagged packets. The VLAN configuration tags are organized into 
the areas of enabling, VLAN management, disabling VLAN management, and 
configuring VLAN management specific options and VLAN management tables. 
For enabling and disabling VLAN management, one command enables VLAN 
management and another command disables VLAN management. For configuring 
the VLAN management's specific options, one command configures the VLAN 
management ID. The default VLAN management VLAN ID is 4092. One 
command sets the VLAN management ID back to the default of 4092. Another 
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command disables untagged IP forwarding. Another command enables untagged 
IP forwarding. In the default case untagged IP packets are forwarded. Another set 
of commands concern the configuring of the VLAN management table. One 
command configures a default route for all off-network outbound traffic. Another 
command deletes the default route for all off-network outbound traffic. A 
command configures the static destination host entry in the table. Still another 
command deletes the static destination host entry in the table. A command 
configures the aging interval for all dynamic entries in the table; the default is 20 
minutes. Another command puts the aging interval back to the default of 20 
minutes. One command displays the VLAN management table, another clears all 
the dynamic entries into the VLAN management table. 

[0060] Other VLAN commands include a command that assigns a VLAN ID for 
an interface and enables VLAN tagging for all incoming packets for that interface. 
Yet another command disables VLAN tagging on an interface. Additionally, a 
command is used to indicate whether packets are VLAN-tagged at a WAN or LAN 
interface by the VLAN tagging unit. Still another command clears the VLAN 
tagging at a specific interface. The commands described above are merely 
exemplary and it is known that other types of commands can be used for the 
VLAN forwarding and the VLAN management. 

[0061] Fig. 12 illustrates a scenario in which a customer presence equipment 
users own their routers, which are not VLAN tagging units. In this case, the 
VLAN tagging unit 182 VLAN tags the incoming WAN traffic with VLAN IDs 
based on the incoming WAN traffic bundle. From the point of presence, the unit 
182 will connect to customer router 184, 186 or 188 by a connection protocol such 
as point to point protocol (PPP), the multi-link point to point protocol (MLPPP), 
frame relay (FR), multi-link frame relay (MLFR) or HDLC. In a bridging mode, 
the MAC addresses are preserved over the WAN link. Thus the unit 182 is 
transparent between the node site and the hub site. To support routing or IP 
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multiplexing, the spoofed MAC addresses are generated with respect to each of the 
WAN bundle connections and fragmentation supported. 

[0062] From the node site to the hub site, the unit 182 should tag packets with 
configurable VLAN ID going towards the point of presence backbone. As 
described above, the packets are preferably tagged based upon the logical interface 
connection to the unit 182. From the hub site to the node site, the unit untags the 
packets sent to the node site. The VLAN ID indicates uniquely which logical 
interface, such as a WAN bundle, the untagged packet should traverse to get to the 
correct node site. 

[0063] Fig. 13 illustrates a scenario in which customers in the same node or 
building can connect to the building CPE unit 190 by either an Ethernet or by a Tl . 
If the connection is made through a Tl, then the building CPE unit 190 tags the 
incoming LAN traffic on a per bundle basis, and forwards the packet out to the 
upstream WAN bundle interface of unit 192. In the scenario of Fig. 13, VLAN 
bridges between the unit 190 and 192 can be done. In building Tls will connect to 
the unit 190 according to a number of possible protocols. 

[0064] In bridging mode, the MAC addresses are preserved over the WAN link 
and the units 190 and 192 are transparent between the node site and the hub site for 
both the Ethernet and in-building Tl customers. In an IP multiplexing mode, the 
spoofed MAC addresses are generated and fragmentation supported. For in- 
building Tl customers from a node site to a hub site, the unit 190 tags packets with 
a configurable VLAN ID going towards the backbone over the WAN link. Packets 
are tagged based on arriving bundle Tl interface. For in-building Tl traffic, traffic 
from the hub site to the node site require the unit 190 to untag VLAN packets. 
The VLAN ID of the untagged packet uniquely identifies the packet for the 
appropriate in-building Tl link. 

[0065] Fig. 14 illustrates a system in which a unit 194 is connected to a network 
196 within a node site 198. The unit 194 is connected by Tl line to another unit 
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200. Unit 200 connects across a WAN to another unit 202 at the hub site 204. In 
this scenario, if a connection is made through a Tl, then the unit 194 VLAN tags 
the incoming Ethernet traffic from the tenant network 194 and forwards the packets 
out the WAN bundle to the unit 200. In this example, the node customer is 
connected by the Ethernet to the unit 194 and can be serviced by VLAN bridging 
between the hub site and node site. The in-building Tls using unit 194 preferably 
connects to unit 200 across the in-building Tl by the PPP protocol. MAC 
addresses are preferably preserved over the WAN link of the Tl within the node 
site. Units 194, 200 and 202 are transparent between the node site and the hub site 
for both Ethernet and in-building Tl customers. For in-building Tl customers 
going from node site to hub site, unit 194 tags units with the configurable VLAN 
ID going towards the POP backbone over the WAN link. Packets are tagged at the 
Ethernet interface unit 194. For in-building Tl, traffic coming from the hub site to 
the node site will require the unit 200 to untag VLAN packets. The VLAN ID for 
the untagged packets should uniquely identify the packet for the appropriate in- 
building link. 

[0066] Figs. 15 and 16 relate to flow-based VLAN tagging. In most systems 
described above, VLAN tagging is based solely on the logical interface. This 
means the various flows going into an interface all get tagged with the same VLAN 
ID. It is desired to have flow-based VLAN tagging in which, in addition to the 
interface for the unit, flow-based tagging is done. The additional data used for the 
flow-based tagging include tagging based upon TCP port, tagging based upon UDP 
port, tagging based on destination IP address, tagging based on source IP address, 
and tagging based on IP subnet. Fig. 15 illustrates a situation in which traffic is 
sent to the unit 204 from various buildings in the company. For example, the 
subnet 206 is associated with an engineering building, and building subnet 208 is 
associated with a management building. If the management building needs faster 
network access than the engineering building, the flows can be tagged by the unit 
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204 with different VLAN IDs, and the unit 204 or other units in the network can 
prioritize the data from the different subnets in a different fashion. For example, 
the data from subnet 208 is tagged with the VLAN ID 100 and data from subnet 
206 is tagged with the VLAN ID 200. If the VLAN 200 gets higher priority than 
the VLAN ID 100, the users of the network 206 have higher priority over the users 
of the network 208. This provides a policy-based VLAN forwarding. 
[0067] Fig. 16 illustrates a scenario in which traffic from a single building 210 is 
redirected based upon the type of traffic. For instance, all of the voice traffic 
needs to be switched to the voice network 212 whereas the data traffic is sent 
through the data network 214. In this example the unit 216 tags the traffic 
appropriately. For instance all voice traffic is tagged VLAN ID = 200 and all data 
traffic is tagged 100. The quality service can be set up at the unit 216 such that the 
voice traffic is prioritized over data traffic across the unit 216 from the remainder 
of the network. Flow-based VLAN tagging involves classifying the flows based 
upon certain criteria and tagging them with the VLAN ID associated with the class. 
Packets are classified according to desired classes and tagged with associated 
VLAN ID tags. Flows can be designed upon IP addresses, ports for UDP/TCP 
packets (type of service bits) as well as incoming VLAN IDs. The flow-based 
VLAN tagging preferably uses quality of service indications to implement different 
features. 

[0068] The flow-based VLAN tagging allows for a reduction of ports in the units 
because now the VLAN ID tagging need not be solely based on the interface ports. 
The policy-based VLAN forwarding is advantageous because the packets tagged 
with the VLAN IDs can be forwarded to different elements. For example, in one 
embodiment, VLAN IDs can be used to tag packets sent direct to a cache, such as 
a web cache. Additionally the VLAN IDs can be prioritized and forwarded based 
on a priority level. 
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[0069] The flow based VLAN tagging allows for a great amount of flexibility of 
classification. The classification can be done based on source and destination IP 
addresses, source and destination ports, type of service bits, as well as VLAN IDs. 
Also, flow-based VLAN tagging allows the possibility of retagging VLAN packets 
was different VLAN IDs. For example various VLAN flows can be aggregated to 
a single VLAN flow. Additionally the classification can be done at multiple levels. 
For instance the first level of classification can be based on an IP address and the 
second level of classification based on ports. This means that HTTP packets from 
one subnet gets a different VLAN ID from the HTTP packets from an other subnet 
[0070] In one embodiment a packet entering the unit is first classified to a 
particular class based on VLAN IDs, IP addresses, TOF bits and/or ports. If the 
packet cannot be classified into a class, the packet is discarded or added to a default 
class. Once the packet is classified, it is tagged based upon the associated VLAN 
tag. After being tagged, the packet will be VLAN-forwarded based on the VLAN 
forwarding table. In one embodiment, different commands can be used to set up 
the VLAN tagging class, display VLAN tagging class and display VLAN tagging 
class information. 

[0071] Fig. 17 illustrates a system with units 220, 222, and 224 connected by 
WAN connections. Units 220 and 222 are connected to an Ethernet connection to 
local customers. The unit 224 has a LAN connection to POP equipment. Note that 
since multiple customers can send data through bundles, it is desirable to have the 
quality of service based upon the VLAN ID. In this case, for example, unit 220 
can define a quality of service distinguished between two different VLAN IDs 
across the logical interface. In this case four Tl's are multi linked into a four 
Tl/MLPPP. In this example, the VLAN A has a committed information rate of 
two-thirds the bandwidth of the bundled WAN connection. VLAN D has a 
committed information rate of one-third the bandwidth of the bundled WAN. As 
shown in Fig. 18, the burst rates for the different VLANs can be different from the 
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committed information rate to allow for bursting traffic. Other quality of service- 
based indications can include policing policies (that is whether to throw away data 
that a unit sends outside the QOS parameters), prioritization policies and shaping 
policies. The use of the quality of service indications prevent a single VLAN from 
consuming all the available bandwidth, locking out the other VLANs. To prevent 
any one VLAN from flooding the available bandwidth, each VLAN is preferably 
assigned a committed information rate and a burst rate. 
[0072] In one embodiment, the Internet traffic is divided into classes. 
Classification based on VLAN IDs is important for this application, but other 
classifications can be supported as well. Each class has a committed information 
rate (CIR) and a burst rate assigned to it. The availability of a burst rate allows 
more value for the customer since the Internet traffic tends to be bursty. As long 
as the bursts from the different customers do not occur at the same time, each 
customer can enjoy more than the allocated bandwidth. Note that the classification 
system for QOS is preferably similar to that described above with respect to the 
VLAN ID classification. 

[0073] It will be appreciated by those of ordinary skill in the art that the 
invention can be implemented in other specific forms without departing from the 
spirit or character thereof. The presently disclosed embodiments are therefore 
considered in all respects to be illustrative and not restrictive. The scope of the 
invention is illustrated by the appended claims rather than the foregoing 
description, and all changes that come within the meaning and range of equivalents 
thereof are intended to be embraced herein. 



